From the Moon to the Earth: 


Planetary exploration to self-driving cars 
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What's changed since Apollo? 
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Robots before cr 


4, 
¢ Prepare for subsequent human mission ~eacieeas 
¢ Scouting, prospecting, etc. = 
¢ Site preparation, equipment deployment, yas ae 5 
infrastructure setup, etc. a et? 


ots supporting crew 
¢ Parallel activities and real-time support 
¢ Inspection, mobile camera, etc. 
¢ Heavy transport & mobility 


Robots after crew 

¢ Perform work following human mission 
¢ Follow-up and “caretaking” work 

¢ Close-out tasks, maintenance, etc. 
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Robotic “Follow-up” Project 


The problem 
¢ Never enough time for field work 
¢ “If only | could have...” 
= More observations 
= Additional sampling 
= Complementary & supplementary work 


The solution 
¢ Use robots to “follow-up” after 
human mission is completed 
¢ Augment human field work with 
subsequent robot activity 


¢ Use robots for work that is tedious 
or unproductive for humans 
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Haughton Crater 


¢ 20 km diameter impact structure 


¢ ~39 million years ago (Late Eocene) 


¢ Devon Island: 66,800 sq. km (largest uninhabited island on Earth) 
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Geologic Mapping Geophysical Survey 
¢ Document geologic history, ¢ Examine subsurface structure 
structural geometry & major units ¢ 3D distribution of buried ground 
¢ Example impact breccia & clasts ice in permafrost layer 
¢ Take photos & collect samples ¢ Ground-penetrating radar: 


manual deploy, 400/900 MHz 


wa? From the Moon to the Earth 7 


(r<Yo) (ele ]fom nats |¢)e)ialemasssielie 


Stratified | ~~) 399] contact between 
sediments |) Me] carbonates 


View East ) Gray carbonate 
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Geophysical survey results 
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Robotic follow-up results 


Geologic Mapping 
¢ Verified the geologic map in 
multiple locations (revisited and 
confirmed geologic units) 
¢ Amended the geologic map in 
multiple locations (added detail 
to long-range crew observations) 
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Geophysical Survey 


¢ Detail study of “polygons” 
(correlated surface & subsurface 
features identified by crew) 


¢ Measured average depth of 
subsurface ice layer (refined 
observations from crew) 


T. Fong, M. Bualat, et al. (2010) “Robotic follow-up 


for human exploration”. AIAA Space Conf. 
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Our focus 
¢ Study how humans can remotely support robots 


¢ Address the many anomalies, corner cases, and edge cases that 
require unique solutions, which are not currently practical to develop, 
test, and validate under real-world conditions 

¢ Humans provide high-level guidance (not low-level control) to assist 
when autonomy is inadequate, untrusted, etc. 


) Foe = ra Ach 
S& From the Moon to the Earth 13 


Le | 


all 


at Earth-Moon L2 Lé 
¢ 60,000 km beyond lunar farside 
¢ Allows station keeping with minimal fuel 


¢ High-bandwidth, low-latency data 
communication to the lunar surface 

¢ Astronaut remotely operates lunar 
rover from orbiting spacecraft — 
AVATAR in real-life! 


¢ Does not require human-rated lander 
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Key Points 


¢ Demo crew-control surface telerobotics 
(planetary rover controlled from space) 


¢ Test human-robot conops for 
future exploration mission 


¢ Obtain baseline engineering data 
(robot, crew, data comm, task, etc) 


Implementation 
¢ Lunar libration mission simulation 
¢ Astronaut on Space Station 
¢ K10 rover in NASA Ames Roverscape 
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Expedition 36 testing 
June 17, 2013 — C. Cassidy, survey 
July 26, 2013 — L. Parmitano, deploy 
Aug 20, 2013 — K. Nyberg, inspect 
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Chris Cassidy remotely operates K10 
from the ISS to perform site survey (2013-06-17) 
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K10 performing surface survey 
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Luca Parmitano works with K10 to deploy 
Se simulated polymide antenna (2013-07-26) 
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K10 deploying simulated polymide antenna 
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Deployed simulated polymide antenna (three “arms”) 
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Karen Nyberg works with K10 to document 
oS deployed simulated antenna (2013-08-20) 
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K10 documenting simulated polymide antenna 
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NASA and self-driving cars 


NASA Missions 


Planned human- 
machine interaction 


Natural and time 
delayed environments 


Aerial, space, and 
planetary navigation 


On-board and 
ground control 
autonomy 


Cyber-security for 
“one-off” systems 


Common Technologies 


Autonomy 
Advanced Planning & 
Scheduling Algorithms, etc. 


Human-Autonomy Teaming 
Robotic Supervision including 
Human/Robotic Interactions, etc. 


Networked Operations 


Remote Vehicle Management, etc. 


Prognostics / Diagnostics 
Including State Management, etc. 


Sensors and Perception 
Data Processing / Fusion 
Methodologies, etc. 


Verification and Validation 
Methodologies & 
Application Experiences, etc. 


Self-Driving Cars 


Diverse human- 
machine interaction 


Structured 
environment 


GPS & map-based 
navigation 


Distributed and 
cloud-based 
autonomy 


Cyber-security for 
consumer product 
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Public/private partnership 


¢ Google (2014-15): selldporatve 
testing of sensors and vehicles 


¢ Nissan (2014-17): cooperative 
software development 
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NASA interest 
¢ Expand knowledge of commercial 
autonomous systems 


¢ Develop protocols and best practices 
for safe testing of real-world autonomy 


¢ Transfer NASA technology to 
terrestrial applications 


echnology maturation 
¢ Safe testing in urban environment 
¢ Leverage NASA expertise in 
autonomy, robotics, safety critical 
S systems, and vehicle systems 


From the Moon to the Earth 


a 


26 


_~ 


When a construction worker uses hand gestures to provide guidance, or 
direction, no autonomous car today can reliably make the right decision. 


¢ When the sun is immediately behind a traffic light, most cameras will not 
be able to recognize the color of the signal through the glare. 


¢ If we see children distracted by the ice cream truck across the street, 
we know to slow down, as they may dash toward it. 


— Andrew Ng (Wired, 3/15/2016) 
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Astronaut helping planetary rover 
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Vehicle assist: Situation assessment 
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Image #1183 
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Vehicle assist: High-level guidance 


© VERVE for NRC-SV 
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Consumer Electronics Show (2017) 
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. hase ane mature terrestrial robotics technology for space use 

¢ Identify and transition low-TRL technology from academia 

¢ Build commercial products for economies of scale & sustainability 
Help NASA move beyond “one-off”? components and systems 

Next solicitation: January 2018 
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Neo Geography RAPID 
Toolkit (NASA robot 
(Ames Stereo Pipeline) middleware) 
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Working with NASA: Partnerships 


Academic Commercial Government 
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Robotics and Machine Vision 
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Intelligent Robotics Group 
Intelligent Systems Division 
NASA Ames Research Center 


irg.arc.nasa.gov 
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